Some Remarks on Periodic Billiard Orbits 
in Rational Polygons 

M. Boshernitzan(i), G. Galperin(2)(3), T. Kriiger^^), and S. Troubetzkoy(2)(4) 

1. Introduction 

A billiard ball, i.e. a point mass, moves inside a polygon Q with unit speed along a straight line 
until it reaches the boundary dQ of the polygon, then instantaneously changes direction according to the 
mirror law: "the angle of incidence is equal to the angle of reflection," and continues along the new line 
(Fig. 1(a)). Despite the simplicity of this description there is much that is unknown about the existence and 
the description of periodic orbits in arbitrary polygons. On the other hand, quite a bit is known about a 
special class of polygons, namely, rational polygons. A polygon is called rational if the angle between each 
pair of sides is a rational multiple of tt. The main theorem we will prove is 

Theorem 1. For rational polygons, periodic points of the billiard How are dense in the phase space Ai of 
the billiard How. 

Theorem 1 is a strengthening of Masur's theorem [M] who has shown that any rational polygon has 
"many" periodic billiard trajectories; more precisely, the set of directions of the periodic trajectories are 
dense in the set of velocity directions S^. We will also prove some refinements of theorem 1: the "well 
distribution" of periodic orbits in the polygon and the residuality of the points q E Q with a dense set of 
periodic directions (precise statements of these results will be given in section 3). 

The structure of the article is as follows. In section 2 we will give a brief description of billiards in 
polygons and some results related to theorem 1. In section 3 we will state the strengthenings of theorem 1, 
and the proofs will be given in section 4. 

2. Description of billiards in polygons 

The trace of a moving billiard ball is called a billiard trajectory or orbit. If a billiard trajectory hits 
a vertex of the polygon, then it is called singular. For convenience we will define such billiard trajectories 
by continuity from the left (with respect to a fixed orientation of the boundary), thus every trajectory is 
infinite and the singular trajectories are the discontinuities of the flow. It is convenient to consider the 
set of singular trajectory segments which start at a vertex and end at a vertex. Such segments are called 
generalized diagonals and the number of links is called the length of the generalized diagonal (Fig. 1(b)). We 
remark that the set of generalized diagonals is countable. If a billiard ball returns to its initial position and 
has the same velocity direction, then its orbit is called periodic (Fig. 1(c)). 
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There is a very useful tool in the analysis of billiards in polygons: the unfolding of trajectories. Instead of 
reflecting the trajectory with respect to the side of the polygon it hits we reflect the polygon itself with respect 
to the same side. The two adjacent links of the trajectory then become part of a straight line (Fig. 2(a)). 
Continuing this procedure for ever unfolds the trajectory into a half-line through a forward corridor of 
polygons. The backward trajectory can be similarly unfolded. We enumerate the unfolded polygons starting 
with zero, while the length of an unfolding is the number of polygons it contains (Fig. 2(b)). 

The set of pairs {{q,v)}, where q € Q is a. position of the ball and t; e is its velocity constitute 
the phase space ^A of the billiard flow. The phase space A4 can be thought of as a right prism foliated 
with a collection of "floors" Q{(p) := Q x ip with ip € S^. Then the billiard flow in the phase space can be 
imagined as a straight line flow on the floors of the phase space. When the flow reaches the boundary it 
jumps from the point {q, (p) to the point {q, ip') on the floor Q{(p'), where ip and ip' are related by the mirror 
law (Fig. 3). In the case the polygon is rational, the flow is restricted to a finite number of floors. Using the 
identifications of the boundary one can glue these floors together to produce an orientable surface R^, (see 
the survey article [Gu] for a full explanation). 

For any (p G for which contains no generalized diagonal the flow (pt restricted to the invariant 
surface R^ is minimal, i.e. the orbit of every point is dense [Gu]. Using Teichmiiller theory Kerckhoff, Masur, 
and Smillie showed that for almost every y> G the flow (/>t|fl^ is uniquely ergodic, i.e. the only ergodic 
invariant measure is the Lebesgue measure [KMS]. Using similar techniques Masur has shown that for a 
dense set of directions (p G the flow <pt restricted to R^p has at least one periodic point [M]. However, his 
result gives no indication of the location of the periodic orbit on the invariant surface R^. 

3. Results 

Throughout this section we will assume that Q is a rational polygon. 

Theorem 1. Periodic points of the billiard Bow are dense in the phase space A4. 

We will also prove a slightly stronger theorem. For this purpose we need one more definition. A periodic 
orbit 7 is called e-well distributed on the table if for every convex set A c Q 

length(7 n A) 
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length(7) 

Here the length of a periodic orbit is its geometric length, not the number of links in its trajectory. 

Theorem 2. The set of e-well distributed periodic points of the billiard How is dense in the phase space 
A4 for every e > 0. 

Let V be the set of Q's vertices and 
G := ^q G Q\V : Ve > 0, for a dense set of directions ip, {q, ip) is an £-well distributed periodic pointj. 
As another refinement of theorem 1 we have: 



Theorem 3. G is residualM^ 

The natural question arises: does G = Q\V for all rational polygons? Does G = Q\V mod(O) for all 
polygons? 

Equality in the stronger sense holds for Coxeter chambers (polygons which tile the plane under their 
reflection group), almost integrable polygons (finite unions of Coxeter chambers) [Gu], regular polygons, and 
closely related polygons [V]. Next we consider 

-B := I? e Q\V : there is no direction ip for which {q, ip) is periodicj. 

We remind the reader that we have a standing assumption that Q is a rational polygon. 

Theorem 4. If Q is convex then B is contained in a finite union of segments. If Q is a triangle, then B is 
at most finite. 

Finally we turn to the question: for which angles (p is there at least one orbit which is not e-dense? We 
show: 

Theorem 5. The set of directions for which there exists a non e-dense orbit is an at most countable closed 
set for any £ > 0. There are examples when this set is not finite. 

4. Proofs of theorems 
Proof of theorem 1: 

First of all we fix a uniquely ergodic direction ^ G S^. As mentioned above by avoiding a countable set 
of ^'s we can assume that Re contains no generalized diagonals. We claim that using the unique ergodicity 
we can choose N so large that for all x & Re the first A'' links of a; 's- forward orbit and the first N links of 
a;'s-backward orbit are both e/2-dense in the surface Re-^"^^ To see this note that the unique ergodicity of the 
flow implies that for every continuous function g the ergodic average 1/T g{<f)tx) dt converges uniformly 
to Jj^^gdnheh (see [W] for the proof which holds without change in this more general setting). 

There are only a finite number of generalized diagonals of length less than or equal to 2A''. In the 
phase space A4 these generalized diagonals lie on a finite number of floors Q{(fii), Q{ip2), . . . , Q{Vk{N))- Let 
6 := Sn > he so small that for any 6' satisfying \6 — 0'\ < S we have Q{ipi) n Re' = for i = 1, . . . , k{N) 
(Fig. 4). Therefore, if a generalized diagonal belongs to Re', then its length is greater than 2N. 

From Masur's theorem we know that there is a periodic point whose direction is arbitrarily close to 6. In 
particular, we can find a periodic point (g'Oi Vo) G -^4 satisfying \(po — 6\<6 and < e/{2- const • N ■ diam Q). 
Here, const is a constant depending on 6, which will be defined later. We consider the point {qo,0) and its 
forward unfolding of length N and its backward unfolding of length N. We claim that either the corridor 

A set is called residual if it contains a dense G^ set, i.e. a countable intersection of open dense sets. 
This fact can also be derived from the minimality of the direction 6. 
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of length N for the forward trajectory of {qo, ipo) or the corridor of length N for the backward trajectory of 
(90, ^0) coincides with the same length corridor of (go, 0). 

Suppose this is not true. The forward corridors of (g'o, ^) and (go, Vo) coincide for a while. Define ji < N 
to be the length of the forward part of the corridors of {qo, 6) and (go, <^o) that coincide. The two corridors 
"branch" apart at polygon number ji — 1; let A be the common vertex of branching corridors. Similarly, 
let j2 < A'' be the length of the backward corridors and B the common vertex of the backward branching 
corridors. Then the straight line segment AB inside the corridor of (go, 9) is a generalized diagonal of length 
ii +^2 — 1 < 2 A''. The direction of AB lies in the interval of directions {t: 6 <t <ipQ} (we assume v'o > 6) 
and thus is its distance to 6 is less than 5 (Fig. 5). This contradicts the choice of 5. 

Without loss of generality we will assume that both the periodic trajectory and the uniquely ergodic 
trajectory stay in the same forward corridor. The endpoints of these two trajectories lie on the boundary of 
the (AT — l)st polygon. Since |<^o — ^| < e/(2-const-A''-diam(3) it follows that if the const is small enough, then 
the distance between the endpoints of the two unfolded trajectories is less than e/2 (Fig. 6). Furthermore, 
the first N links of the uniquely ergodic trajectory are e/2-dense in Rq. These two facts combined show that 
the periodic trajectory is £-dense in R^^ . This can be done for every uniquely ergodic direction 6. The set 
{Re : (j)\Ri) is uniquely ergodic} is dense in the whole phase space M.. Since e is arbitrary this completes the 
proof of theorem 1. ■ 

Proof of theorem 2: 

We given an equivalent definition of e-well distribution. We fix an embedding Q c R^. Let ^p,g,r,s be 
the intersection of Q with the open ball with center {p/q,r/s) and diameter l/(max(g, s)). Enumerating 
gives rise to the countable basis {Ai}. A periodic orbit 7 is e-well distributed on the table if for each set Ai 
with diam(Aj) > e 

length(7 n A, 



- MLeb(^j) 



length(7) 

For a fixed suflaciently small e > for a convex set A with sufficiently small diameter equation 1 automatically 
holds, and we can approximate any convex set A with large diameter by finite unions and intersections of 
the Aj . Using this reasoning one can show that for every 6 > there is a £ > so that any £-well distributed 
point in the sense above is 5- well distributed in the sense of section 2 and £ — > as 5 — > 0. 

We need to modify several steps in the proof of theorem 1. In the proof of theorem 1 we choose N so 
large that the first N links of a;'s forward and backward orbit are both £/2-dense. The proof given there 
actually shows the stronger result, both orbit segments are £/2-well distributed as well (the definition of 
well distributed is analogous to the one for periodic points introduced in section 3). We choose the integer 
N slightly larger so that the first N links are £/3-well distributed. We also choose N so large that for any 
k > N if the first k links of the orbit of any point x are 2£/3-well distributed then the first k + 1 links are 
£-well distributed. 

We choose S := S2N and the periodic point (go, <po) so that it satisfies \(po — ^| < 62N and < £/(3 • const • 



2A'' • diamQ). Then the periodic trajectory of (905^0) shadows the e/3-well distributed uniquely ergodic 
trajectory for 2N Unks either forward or backward. Thus the first 2 A'' Hnks of this orbit are 2e/3-well 
distributed and the first 2 A'' + 1 Hnks are £-well distributed. Suppose the number of links of the (go,<Po) 
trajectory is M. If M < 2N + 1, then the trajectory is clearly e-well distributed. 

If M > 2N + 1 let the cyclically ordered set {Li, L2, ■ ■ ■ , Lm} denote the links of the trajectory. We 
want to partition the trajectory into e-well distributed trajectory segments of lengths between N and 2N. 
Prom formula (1) it is clear that the concatenation of e-well distributed trajectory segments is itself e-well 
distributed. Therefore, the construction of such a partition will finish the proof. 

To construct such a partition we start by covering the trajectory by trajectory segments, i.e. by or- 
dered sets {Li, . . . , Z/j+2JV-i} of length 2N that are e-well distributed and for which all its ordered subsets 
{Lj, . . . , c {Li, . . . , ij+2jv-i} of length k > N are also e-well distributed. Without loss of gen- 

erality we suppose that {Li, . . .L2n} as well as all its consecutively ordered subsets of length k > N are 
2e/3-well distributed. Now we apply this argument again to the point (^t(2jv+i)(90j Vo) to conclude that 
either {L2, ■ . ■ , L2N+1} or {i2JV+2, • • • , L4N+1} has this property. If the latter occurs, then the link L2N+1 
is not covered. In this case we replace {Li, . . . , L2n} by {Li, . . . , L2N+1} which is e-well distributed. Con- 
tinuing this process inductively yields the desired covering (Fig. 7). To finish the proof we split the covering 
into a partition of e-well distributed pieces of different lengths, but with all the lengths being at least N and 
at most 2A''. ■ 

Proof of theorem 3: 

Fix a uniquely ergodic direction 6. Let 

AI{6) := e Q\V : {q, ip) is an e-well distributed periodic point for some ip, \ip — 6\ < 

In the proof of theorem 1 we showed that for all uniquely ergodic directions 9 and for all e > there is a 
6 := S{0,e) > such that Al{0) is dense in Q. The set is also open because each periodic point is 

contained in an open strip, that is if x = {q, (p) is periodic, then there is an open disc D C Q\V such that 
{q',f) is periodic for all q' £ D (see [GKT]). Choose a countable dense set of uniquely ergodic directions 
{9i} C and Si > satisfying limj^oo = 0. Furthermore choose positive numbers 6i < d{6i, Si) such that 
limj^oo 5i = 0. Then 

iez+ 

and thus G is residual. ■ 
Proof of theorem 4: 

First we will show that the set B is contained in a finite number of line segments. To do this we will 
consider only billiard trajectories which hit some side of the polygon perpendicularly. Let ipi be the direction 
perpendicular to the ith side of Q. As discussed in section 2, the invariant surface R^^ contains at most a 
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finite number of generalized diagonals. Any perpendicular trajectory which enters a vertex is automatically 
a generalized diagonal because its backward orbit also enters the same vertex. This means that only a finite 
number of points on the ith side have singular perpendicular trajectories. The number of such diagonals is 
clearly less than the number of floors of the invariant surface R^^ multiplied by the number of vertices of Q. 
We remark that the number of R^^ 's floors is less than the greatest common denominator of all the inner 
angles of the polygon. 

The perpendicular orbit through any other point on the ith side hits that side perpendicularly twice 
and thus is periodic (for details see [Bo][GSV]). For each point q € Q we consider the perpendiculars to the 
straight lines containing the sides of Q. Since Q is convex, for the nearest side of Q, the base point of this 
perpendicular will belong to an interior point of the side and not to its continuation. Consequently, any 
point q which is not covered by one of the finite number of generalized diagonals from the surfaces UiR^^ 
has a "perpendicular" periodic orbit passing through it. 

We remark that using the ideas from the proofs of theorems 1-3 we can show a slightly stronger result. 
Namely, B is contained in a Cantor subset of these segments. 

If Q is an acute or right triangle, then for each q G Q\V the perpendicular to the lines containing the 
sides lie inside Q {ifq G dQ, then this perpendicular is just the point q). For obtuse triangles the same is true 
for at least two sides. Thus for rational triangles, for each q G Q\V there are at least two distinct singular 
perpendicular billiard orbits passing through q. Each point q G Q\V which is not covered by a perpendicular 
periodic trajectory must be covered by two distinct perpendicular generalized diagonals. However, any two 
generalized diagonals which intersect do so transversely or else they would coincide. If di, . . . ,dk denote the 
perpendicular generalized diagonals, then B is contained in [Jijtj{di fl dj), a finite set. ■ 

Question: For which polygons are all q G Q\V at least double covered by perpendicular trajectories? 
Note that this does not hold for the regular hexagon although in this case it is easy to see that B is empty. 

Proof of theorem 5: 

Let 

Ce := : 3x € Rcp such that the orbit of x is not £-dense |. 

If R^ contains no generalized diagonal, then the flow (t>\R^ is minimal and thus every billiard orbit is dense. 
The set of generalized diagonals is at most countable and thus so is C^. 

The set is clearly closed, for if tpi G Ce and Xi G R^^ is not an e-well distributed point, then any 
weak limit point of the Xi is also not an £-well distributed point. 

An example where is countable is the following. We consider the L-shaped figure consisting of three 
identical squares as depicted in figure 8(a). In this flgure a periodic orbit with 4 links which avoids the right 
hand square is shown. In figure 8(b), an unfolding of length 3 of the L-shaped figure along with a periodic 
orbit with 8 links is drawn. This periodic orbit also never enters the right hand square. In general, the 
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analogous unfoldings of length k contains a periodic orbit with 2k + 2 links which avoids the right hand 
square. ■ 
Question: are there convex examples of this phenomenon? 



5. Acknowledgements 

MB is partially supported by NSF-DMS-9224667. GG is supported by the Alexander von Humboldt 
Stiftung. ST was supported during part of this research by the Deutsche Forschungsgemeinschaft. 

6. References 

[BKM] C. Boldrighini, M. Keane, and F. Marchetti Billiards in polygons Ann. Prob. 6 (1978) 532-540. 

[Bo] M. Boshernitzan Billiards and rational periodic directions in polygons Amer. Math. Monthly June-July 
(1992) 522-529. 

[GKT] G. Galperin, T. Kriiger, and S. Troubetzkoy Local instability of orbits in polygonal and polyhedral bil- 
liards, Comm. Math. Phys. (1994) (to appear). 

[GSV] G.A. Galperin, A.M. Stepin, and Ya.B. Vorobetz Periodic billiard trajectories in polygons: generating 
mechanisms Russian Math. Surv. 47:3 (1992) 5-80. 
[Gu] E. Gutkin Billiards in polygons Physica D 19, (1986) 311-333. 

[KMS] S. Kerckhoff, H. Masur, and J. Smillie Ergodicity of billiard flows and quadratic differentials Annals 
Math. 124 (1986) 293-311. 

[M] H. Masur Closed trajectories for quadratic differentials with an application to billiards Duke Math. J. 53 
(1986) 307-313. 

[V] W. Veech The billiard in a regular polygon Geom. Func. Anal. 2 (1992) 341-379. 
[W] P. Walters An introduction to ergodic theory, Springer- Verlag, 1982, 



7. 


Figure captions 


Fig. 
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(a) The mirror law, (b) a generalized diagonal, (c) a periodic orbit 


Fig. 
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Unfolding a trajectory 


Fig. 


3 


The mirror law in phase space 


Fig. 
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The ^-neighborhood of Re does not contain a generalized diagonal of length less than 2A'' 


Fig. 
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Branching corridors 


Fig. 
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e/2-shadowing of length N 


Fig. 


7 


Covering the trajectory by well-distributed trajectory segments 


Fig. 
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Periodic orbits in the L-shaped figure which do not enter the right hand square 
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